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ABSTRACT 

Advanced knowledge acquisition in a subject area is 
different in many important ways from introductory learning (and from 
expertise). In this paper some of the special characteristics of 
advanced learning of complex conceptual material are discussed. The 
paper notes that these characteristics are often at odds with the 
goals and tactics of introductory instruction and with psychological 
biases in learning. The paper alludes to research in biomedical 
cognition that has revealed a substantial incidence of misconception 
attributable to various forms of oversimplification and outlines the 
factors that contribute to suboptimal learning at the advanced stage. 
A sketch of a theoretical orientation for more successful advanced 
knowledge acquisition in ill-structured domains. Cognitive 
Flexibility Theory, is then presented. This orientation emphasizes: 
the use of multiple mental emd pedagogical representations; the 
promotion of multiple alternative systems of linkage among knowledge 
elements; the promotion of schema assembly (as opposed to the 
retrieval of prepackaged schemas); the centrality of "cases of 
application" as a vehicle for engendering functional conceptual 
understanding; and the need for participatory learning:, tutorial 
guidance, and adjunct support for aiding the management of 
complexity. The paper also discusses a computer hypertext approach 
that implements cognitive Flexibility Theory. (Fifteen references are 
attached.) (Author/RAE) 
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Abstract 

Advanced knowledge acquisition in a subject area is different m many important ways from 
introductory learning (and from expertise). In this paper we discuss some of the special characteristics 
of advanced learning of complex conceptual material. We note how these characteristics are often at 
odds with the goals and tactics of introductory instruction and with psychological biases in learning. 
We allude to our research in biomedical cognition that has revealed a substantial incidence of 
misconception attributable to various forms of oversimplification, and we outline the factors that 
contribute to si boptimal learning at the advanced stage. We then sketch a theoretical orientation for 
more successful advanced knowledge acquisition in ill-structured domains, Cognitive Flexibility Theory. 
This orientation emphasizes: the use of multiple mental and pedagogical representations; the 
promotion of multiple alternative systems of linkage among knowledge elements; the promotion of 
schema assembly (as opposed to the retrieval of prepackaged schemas); the centrality of "cases of 
application" as a vehicle for engendering functional conceptual understanding; and the need for 
participatory learning, tutorial guidance, and adjunct support for adding the management of complexity. 
A computer hypertext approach that implements Cognitive Flexibility Theory is discussed. 



ERIC 



O 



Spiro, Coulson, Feitovich, & Anderson 



Cognitive Rexibility Theory - 2 



COGNITIVE FLEXIBILITY THEORY: 
ADVANCED KNO\^XEDGE ACQUISITION 
IN ILL-STRUCTURED DOMAINS 



The Goals of Advanced Knowledge Acquisition 

In our work we have been b^erested in "advanced knowledge acquisitions-learning beyond the 
introductory stage for a subject area, but before the achievement of practiced expertise that comes with 
massive experience. This often neglected mtermediate stage is important becau^ the aims and means 
of advanced knowledge acquisition are different from those of introductory learning. In introductory 
learning the goal is often mere exposure to content and the establishment of a general orientation to a 
field; objectives of assessment are likewise confined to the simple effects of exposure (e.g., recognition 
and recall). At some point in learning about a knowledge domain the goal must change; at some point 
students mvst "get it right." This is the stage of advanced knowledge acquisition (Feitovich, Spiro. & 
Coulson, in press; Spiro, Feitovich, & Coulson, in press; Spiro, Vispoel, Schmitz, Samarapungavan, & 
Boerger, 1987): The learner must attain c deeper understanding of content material, reason with it, ari 
apply it flexibly in diverse contexts. Obstacles to advanced knowledge acquisition include conceptual 
complexity and the increasing ill-structuredness that comes into play with more advanced approaches 
to a subject area. By ill-structuredness we mean that many concepts (interacting contextually) are 
pertinent in the typ»cal case of knowledge applicatiot, and that their patterns of combination are 
inconsistent across case applications of the same nominal type. (See Spiro, et al., 1987, for a more 
detailed treatment of the nature and consequences of ill-structuredness.) 

The methods of education in introductory and advanced learning seem, in many ways, to be at odds. 
For example, compartmentalizing knowledge, presenting clear instances (and not the many pertinent 
exceptions), and employing reproductive memory criteria are often in conflict with the realities of 
advanced learning-knowledge which is intertwined and dependent, has significant context-dependent 
variations, and requires the phility to respond flexibly to "messy" application situations. These 
discrepancies in aims and tactic* (along with many others that we have observed) raise the possibility 
that introductory learning, even when it is "successful," lays foundations m knowledge and in an 
approach to learning that interfere with advanced acquisition. As we have seen repeatedly 
demonstrated, that possibility is an actuality (Coulson, Feitovich, & Spiro, 1986; Feitovich, et al., in 
press; Spiro, et al., in press; Spiro, et al., 1987). 

Deficiencies in Advanced Knowledge Acquisition 

Medical school is an archetype of an advanced knowledge acquisition setting (Feitovich, et al., in 
press). Medical students have already had introductory exposure to many of the subject ar^as of 
biological science that they go on to study in medical school, but they are certainly not yet e..pert. 
Furthermore, the goals of medical education are clearly those of advanced knowledge acquisition. 
Important aspects of conceptual complexity must now be mastered (superficial familiarity with key 
concepts is no longer sufficient); and the ability to apply knowledge from formal instruction to real- 
world cases is certainly something that is expected of those studying to be physicians. 

In our laboratory we have been studying medical students' learning, understanding and application of 
important but difficult biomedical science concepts. This effort has revealed widely held systematic 
misconceptions among students, despite their having been exposed to appropriate information 
(Coulson, et al., 1986; Feitovich, et al., in press; Spiro, et al., in press; Spiro, et al., 1987). Stubborn 
misconception, notwithstanding usual classroom efforts at mstruction, have been found for difficult 
concepts in other areas as well (e.g., physics: Champaign, Gunstone, & Klopfer, 1985; White, 1984). 
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The biomedical misconceptions that wc have identified are of various kinds (Feltovich, et al., in press; 
Spiro, et al., in press). These include contentive errors, often involving overgeneralization; for example, 
areas of subject matter are seen as being more similar than they really are. Errors attributable to 
dysfunctional biases in mental representation arc also observed; for example, dynamic processes are 
often represented more statically. Prefigurative *\vorld views*" that underlie learners' understanding 
processes also cause problems; for example, the presupposition that the world works in such a way that 
"parts add up to wholes" leads students to decompose complex processes into components that are 
treated (mistakenly) as independent. Furthermore, at all these levels misconceptions interact in 
reciprocally supportive ways, and combine to yield higher order misconceptions (Couison, et ah, 1986; 
Feltovich^ et al., in press). Failures of understanding com/'ou/id themselves, building up durable chains 
of larger scale misconception. 

Reductive biases: The pervasive role of oversimplification in the development cf misconceptions. A 
predominant share of the misconceptions (and networks of misconception) that we have identified 
reflect one or another kind of oversimplification of complex material-associated with learners' earlier 
experiences with introductory learning, and even influenced by many experiences with advanced 
learning. Misconceptions of advanced material result both from interference from earlier, simplified 
treatments of that material and from a prevailing mode of approaching the learning process in general 
that fosters simplificational strategies and leaves learners without an appropriate cognitive repertoire 
for the processing of complexity (Feltovich, et al., in press; Spiro et al., in press; Spiro, et al., 1987). 

We have termed the general tendency to reduce important aspects of complexity the reductive bias. 
Several forms of the bias have been identified, selected examples of which follow (see Couison, et al., 
1986; Feltovich, et al., in press; Spiro, et al., in press) for examples of biomedical misconceptions 
corresponding to the types of reductive bias listed): 

1. Oversimplification of complex and irregular structure. Superficial similarities among related 
phenomena are treated as unifying characteristics. Interacting components are treated as independent. 
Incomplete conceptual accounts are presented (or accepted by the learner) as being comprehensive. 
Instances that are referred to as belonging to the same generic category are treated in a uniform 
manner despite their being highly diverse. The irregular is treated as regular, the nonroutine as 
routine, the disorderly as orderly, the continuous as iiscrete, the dynamic as static, the 
multidimensional as unidimensionai. (This first reductive bias is the most general one, encompassing 
many of the specific ones listed below.) 

2. Overreliance on a single basis for mental representation. A single, encompassing representational 
logic is applied to complex concepts and phenomena that are inadequately covered by that logic. For 
example: Understanding of a new concept is reduced to the features of a (partially) analogous concept. 
New, highly divergent examples are understood by exclusive reference to a single prototype. A single 
schema or theory is profferred and preferred, despite the fad that its coverage is significantly 
incomplete. Complexly multifaceted content has its understanding narrowed to just those aspects 
covered by a single organizational scheme. And so on. 

3. Overreliance on "top down" processing. Understanding and decision making in knowledge 
application situations (i.e., cases) rely too exclusively on generic abstractions (i.e., concepts, theories, 
etc.); detailed knowledge of ca5^ structure is not used enough (i.e., knowledge of "how cases go," as well 
as reasoning from specific case precedents). 

4. Context-independent conceptual representation. The contexts in which a concept is relevant are 
treated as having overly uniform characteristics. This promotes the representation of conceptual 
knowledge in a manner too abstract for effective application (i.e., without sufficient regard for the 
specifics of application in context). Concepts are insufficiently tailored to their uses; concepts are not 
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recognized as relevant when, in fact, they arc; and concepts are mistakenly judged to be relevant in 
contexts where they are not 

5. Overrcliance on precompiled knowledge structures. Fixed protocols or rigidly prepackaged schemas 
are presented to learners and used by them as recipes for what to do in new cases. 

6. Rigid compartmentalization of knowledge components. Components of knowledge that are in fact 
interdependent are treated as being separable from each other. Uarners develop mistaken beliefs in 
the mdcpendence of the components. Relatedly, where knowledge components do function 
mdcpendently, it may nevertheless be the case that conveying relationships between their conceptual 
structures would aid understanding; these connections are not drawn. When components are 
mterrelatcd, there is a tendency to use just one linkage scheme, thereby underrepresenting the richness 
of mterconnection in the system and promoting narrow, doctrinaire viewpoints (sec the problem of 
single representations). 

7. Passive transmission of knowledge. Knowledge is preemptively encoded under a scheme 
determined by external autiiority (e.g., a textbook) or a scheme which facilitates delivery and use. 
Knowledge is "handed" to the learner. The preemptive encoding is passively received by the learner, 
and useful benefits that result from personalized knowledge representations, derivable from active 
exploration and involvement in the subject area, do not develop. When active, participatory learning is 
encouraged, adequate support for the management of increased indeterminacy and cognitive load is 
not provided (eg., mentor guidance, memory aids, etc.). 

The next section will outline our theoretical approach to remedying the problems of advanced 
knowledge acquisition that arc caused by these reductive biases. 

Cognitive Flexibilit} The^iy: 
Themes of Advi;nced Knowledge Acquisition 

Where has our research on the problems of advanced knowledge acquisition led us? To an overall 
theoretical orientation that in many ways derives its fundamental themes from the specific nature of 
those learning problems, as the problems relate to the characteristics of ill-structured domains and the 
special goals of advanced knowledge acquisition (i.e., mastery of conceptual complexity and knowledge 
application/transfer). 

In this section we provide a brief discussion of our most fundamental, theoretically motivated remedies 
for the problems of advanced knowledge acquisition. The following themes constitute different facets 
of what we call coptitive flexibility (Spiro, et al., 1987). The themes are, in a sense, conditions for 
developmg mastery of complexity and knowledge transferability. Each of the headlined theoretical 
commitments has received some form of implementation, either in our experiments or in our theory- 
based computer hypertext systems (mcluding one prototype that implements the theory's principles of 
advanced knowledge acquisition in cardiovascular medicine, the Cardioworid Explorer). Given the 
extreme limitations of space, the themes are discussed schematically and in the abstract; detailed 
development of theoretical rationales, examples of our concrete instantiations of the themes (in the 
biomedical domain and others that we have studied), and patterns of empirical support tor our claims 
can be found in our cited papers. 

1. Avoidance of Oversimpiiflcation and Overregularizatioo. Because of the strong bias towards 
oyersunplification tiiat we have observed, it is clear that advanced knowledge acquisition must place a 
high premium on making salient those ways that knowledge is not as simple and orderly as it might first 
seem in introductory treatments. Where the problem is so often a presumption of simplicity and 
regularity, the remedy is to take special measures to demonstrate complexities and irregularities. It is 
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important to lay barr the limitations of initial, first pass understandbgs, to highlight exceptions, to 
show how the superficially similar is dissimilar and how superficial unities are broken. Where 
conceptual error frequently occurs from atomistic decomposition of complexly interacting information, 
followed by misguided attempts at ''additive" reassembly of the decomposed elements, ihe remedy is to 
take pains to hi^li^t component interactions, to clearly demonstrate the intricate patterns of 
conceptual combination. 

This is a very general theme, encompassing many of the others that foUow in this list. Cognitive 
flexibiUty involves the selective use of knowledge to adoptively fit the needs of understanding and 
decision making in a particular situation; the potential for maximally adaptive knowledge assembly 
depends on having available as full a representation of complexity to draw upon as possible. 

2. Multiple Representations. Single representations (e.g., a single schema, organizational logic, line of 
argument, prototype, analogy, etc.) will miss important facets of complex concepts. Cognitive flexibility 
is dependent upon having a diversified repertoire of ways of thinking about a conceptual topic. 
Knowledge that will have to be used in many ways has to be learned, represented, and tried out (in 
application) in many ways. 

The use of multiple representations is important at different levels. For example, we have found 
multiple analogies to be very useful in understanding complex individual concepts (Spiro, et al., in 
press; see the example below of force production by muscle fibers; see also Collins & Centner, in 
press; White & Frederikscn, 1987). Howe-er, the importance of multiple representations may be even 
more important for larger unite of analysis. For example, we have found that students' understandings 
of the entire domain of biomedical knowledge is adversely affected by the tendency to use just one way 
of modeling the various phenomena they encounter, one that comes from the metaphor of the machine. 
This one "lens" leads them to take for granted certain issues related to the nature of explanations, the 
structure of mental modeb of functional systems, and so on. These studente develop understandings 
that do not capture important aspects of the biomedical domain (e.g., inherently organic processes). 
Their understandings would be more complete if they were to augment the selective view that results 
from their mechanistic bias with other understandings that selectively emerge from the unique aspects 
of other cognitive "lenses," for example, from organicist metaphors (Feltovich, et al., in press). 

The need for multiple representations applies not only to complex concepts, but to cases as well. In an 
ill-structured domain, cases (examples, occurrences, events-occasions of use of conceptual knowledge) 
tend to be complex and highly variable, one to the next. The complexity of cases requires that they be 
represented from multiple theoretical/conceptual perspcctivcs-if cases are treated narrowly by 
characterizmg them using a too limited subset of their relevant perspectives, the ability to process 
future cases will be limited. Fu-st, there will be an assumption that cases are simpler than they in fact 
are, and attempte to deal with new cases will prematurely conclude after they are only panialiv 
analyzed. Second, there will be msufficient preparedness to deal with the specific patterns of 
interaction of theoretical/conceptual perspectives within cases. Third, to the extent that performance 
in future cases will require reasoning from sets of precedent cases (which is always a greate need in ill- 
structured domains), the likelihood of having case representations available in prior knowledge which 
are maximally apt b their relation to some new case is lessened to the extent that cases are narrowly 
represented m memory. This is especially so when there is substantial across-case dissimilarity; the 
relative novelty of a new case in an ill-structured domain will require more elaborate efforts to find 
appropriate precedents-the wider the variety that U available, the better the chances of finding a fit. 

An Example of Multiple Representations: Integrated Multiple Analogies for Complex Concepts. As 
we have said, our studies of medical studente have mdicated that one of the most serious contributors 
to the problems of advanced knowledge acquisition is the use of a single knowledge representation. 
Complex concepts can rarely be adequately represented using a single schema, theoretical perspective, 
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line of exposition, and so oa Nevertheless, in practice, complex concepts frequently are represented in 
some single fashion, with substantial consequences. 

Our remedy has been to approach learning in all of the domains that we have studied with the goal of 
promoting multiple representations (e.g., multiple precedent cases for a new case; multiple 
organizational schemes for representing the same content material in our computer hypertexts; etc.). 
Here we will brieHy consider just the case of analogy. We have discovered a large number of 
miscona.ptions that result from the overextended application of analogies (Spiro, ei al., in press). To 
combat the negative effects of a powerful and seductive single analogy, we employ sets of integrated 
multiple anaiopes. Whenever a source concept in an analogy is missing important aspects of a target 
concept, or the source concept is in 'ome way misleading about the target concept, we introduce 
another analogy to counteract those specific negative effects of the earlier analogy. 

So, where we find that misconceptions about the nature of force production by muscle fibers often 
develop because of a common analogy to the operation of rowing crews (sarcomere "arms" and "oars ' 
both generate force by a kind of "puUingf), other analogies arc introduced to mitigate the negative 
effects of the limited rowing crew analogy (Spiro, et al., in press). An analogy to turnbuckles corrects 
misleading notions about the nature of relative movement and the gross structures within the muscle. 
An analogy to "finger handcuffs" covers important information missing in the rowing crew analogy 
about limits of fiber length (the elastin covering on muscle fiber bundles constricts at long lengths, 
stopping extension in a manner similar to the cross-hatched finger cuffs when you try to pull a finger 
out of each end). And so on, A composite imaging technique that helps the user to integrate the 
multiple analogies, so that the correct aspect- of each analogy can be selectively instantiated in relevant 
contexts of use of the target concept, has also been developed. The procedure facilitates the learning 
of a concept (through the pedagogical benefits of analogy), while mamtaining the integrity of the 
concept's complexities (by using multiple analogies to cover the concept's multifacetedness and to 
vitiate the force of incorrect aspects of any single analogy). (Also see Bunstein, 1983.) 

Theoiy-bascd hypertext systems to Implement the themes of advanced knowledge acquisition in ill- 
structured domains: The importance of revisiting and rearninging in the development of multiple 
representaUons. Much of the work on computer hypertext systems has been driven by the power of 
the technology, rather than by a coherent view of the cognitive psychology of nonlinear and 
multidimensional learning and instruction. In contrast, our hypertext approaches have a basis in 
cognitive theory-they derive from the themes of Cognitive Flexibility Theory. And their realm of 
operation is specified; they are especially targeted at advanced knowledge acquisition in ill-structured 
domains. (There is no point in imposing the extra cognitive load of nonlinearity and 
multidimensionality if the domain being studied is simple and well-structured, or if the goals of learning 
are the more easily attainable ones of introductory treatments.) We will briefly characterize our 
approach to implementing Cognitive Flexibility Theory in computer hypertext systems. 

Our hypertext systems build multiple representations in a manner that can be understood using a 
metaphor of landscape exploration. Deep understanding of a complex landscape will not be obtained 
from a single traversal Similarly for a conceptual landscape. Rather, the landscape must be criss- 
crossed in many directions to master its complexity and to avoid having the fullness of the domain 
attenuated (Spiro, et al., 1987; V/ittgenstein, 1953). The same sites in a landscape (the same cases or 
concepts in a knowledge domain) should be revisited from different directions, thought about from 
different perspectives, and so on. There is a limit to how much understanding of a complex entity can 
be achieved in a single treatment, in a single context, for a single purpose. By repeating the 
presentation of the same complex case or concept information in new contexts, additional aspects of the 
multifacetedness of these "landscape sites" are brought out, enabling the kind of rich representations 
necessary in a complex and ill-structured domain. Thus, cogmtive flexibility is fostered by a flexible 
approach to learning and instruction. The same content material is covered in different ways, at 
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difFerent times, in order to demonstrate the potential flexibility of use inherent in that content (Spiro & 
Jehng, in press; Spiro et al., 19^7). 

3. Centraiity of Cases. The more ill-structured the domain, the poorer the guidance for knowledge 
application that "top-down" structures wiU generally provide. That is, the way abstract concepts 
(theories, general principles, etc.) should be used to facilitate understanding and to dictate action in 
naturally occurring cases becomes increasingly indeterminate in ill-structured domains. The 
application of knowledge to cases in an iU-struclured domain (i.e., a domain in which cases are 
individually multidimensional, and irregularly related one to the next) cannot be prescribed in advance 
by general principles. This is because, in ill-structured domains, there is great variability from case to 
case regarding which conceptual elements will be relevant and in what pattern of combination. In an 
ill-structured domain, general principles will not capture enough of the structured dynamics of cases; 
increased flexibility in responding to highly diverse new cases comes increasingly from reliance on 
reasoning from precedent cases. 

Thus, examples/cases cannot be assigned the ancillary status of merely illustrating abstract principles 
(and then being discardable); the cases are key-examples are necessary, and not just nice (Feltovich, et 
al., in press; Spiro & Jehng, in press; Spiro, et al., 1987). 

4. Conceptual Knowledge as Knowiedge-ln*Usc. Not only is it more difficult to count on top down 
prescriptions for performance in new cases in an ill-structured domain (i.e., abstract concepts/theories 
inadequately dctermme responses to new cases), but there is also considerable indeterminateness in 
defining conditions for accessing conceptual structures in the first place, to engage the guidance the 
conceptual structures do offer. It is not that abstract knowledge has no role in ill-structured domains, 
but that its role is highly intertwined with that of case-centered reasoning. Put another way, in an ill- 
structured domain there will be greatly increased variability across cases in the way the same concept is 
used or applied. Thus it is harder to get fi-om features of cases to the concepts that might need to be 
applied to those cases. And it is harder to apply a concept, once accessed, if it has many different kinds 
of uses across cases-concepts must be tailored to their application contexts. The Wittgensteinian 
dictum that meaning is determined by use clearly applies in ill-structured domains. If a concept's 
meaning m use cannot be determined universally across cases (as m an ill-structured doma\.), then one 
must pay much more attention to the details of how the concept is iiscd-'knowledge in practice, rather 
than in the abstract (Spiro & Jehng, m press; Spiro, et al., 1987; Wittgenstein, 1953). 

In medical training, this issue of variability and combination in concept instantiation has an obvious 
implication for the traditional difficulty of integrating the biomedical basic science parts of the 
curriculum with the clinical parts. Physicians* practice would be improved if in problematic situations 
they could apply the mteracting basic biomedical science concepts that underlie the clinical situation 
that is posing the problem. However, it is very difficult for medical students to learn how to get to the 
basic science concepts from clinical presenting features, partly because of the great variability across 
clinical cases in the way those concepts get instantiated. A key feature of our Cardioworid Explorer 
hypertext is that it permits the learner to selectively examine the full range of uses of any selected basic 
science concept (or any selected combination of concepts) across cases with differing clinical features, 
teaching the patterns of concept application and thus facilitating access to conceptual information in 
clinical contexts (as well as fostering an understanding of the different ways that a given concept has to 
be tailored to be clinically relevant). 

Again, in an ill-structured domain the meaning of a concept is intimately connected to its patterns of 
use. When the uses (instances, cases) of the same concept have a complex and irregular distribution 
(i.e., the domain is ill-structured), adequate prepackaged prescriptions for proper activation of the 
concept cannot be provided (i.e., concept instantiation is non-routine). Instead, greater weight (than in 
a well-structured domain) must be given to activating concepts in a new case by examination of family 
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resemblances across the features of past cases that have been called (labeled as instances oQ that 
concept. 

5. Schema Assembly (from Rigidity to Flexibility). In an iU structured domain, emphasis must be 
shifted from retrieval of intact, rigid, precompiled knowledge structures, to assembly of knowledge from 
different conceptual and precedent case sources to adaptively fit the situation at hand (Spiro, 1980; 
Spiro, et al., 1987). This follows, again, from characteristics of ill-structured domains. Since ill- 
slructuredness implies kinds of complexity and irregularity that militate against the use of knowledge 
structures that assume routinizability across cases, the role of intact schema retrieval must be 
diminished-greater across-casc differences cause a necessary decline in the ability of any large, single 
precompilation to fit a wide variety of cases. In complex and iU-stnictured domains, one cannot have a 
prepackaged schema for everything! As ill-stnicturcdncss increases, the use of rigid knowledge 
structures (i.e., the same precompiled knowledge structure used for m-ny cases) must be replaced by 
flexible, recombinable knowledge structures. For any particular case, many small precompiled 
knowledge stnicrurcs wiU need to be used. And there wiU be reUUvcly Uttle repetition of patterns 
across case-spcdfic assemblies of these smaller pieces of precompiled knowledge. Accordingly, in 
knowledge acquisition for cognitive flexibility, the "storage of fixed knowledge is devalued in favor of 
the mobilization of potential knowledge' (Spiro, et aL, 1987; see also Schank, 1982.) 

6. NoncompartmcntaltotSoa of Concepts and Cases (Multiple Interco^^ Because of the 
complex and irregular way that abstract conceptual features weave through cases/examples in ill- 
structured domains, knowledge cannot be neatly compartmentalized. In order to enable the situation- 
dependent, adaptive schema assembly from disparate knowledge sources that characterizes cognitive 
flexibility, those mullipte sources must be highly interconnected. Concepts cannot be treated us 
separate "chapters." Retroactive assembly of independently taught, and noninterrelated, constituent 
conceptual aspects too often fails. Also, although cases have to be focused on separately, so that the 
complexity of case structure is conveyed, they should not be taught in just that way-connections across 
cases must also be established. Rather than relegating concepts or cases to separate compartments, 
chapters, and so on, our systems strive for multiple interconnectedness (of cases and concepts) along 
multiple conceptual and clinical dimensions. 

Our approach to fostering multiple interconnectedness of knowledge representations in our hypertexts 
is to code case segments with a multidimensional vector indicating the relevance of a variety of 
thematic/conceptual dimensions to that case segment (Spiro & Jehng, in press). (Positive values in the 
vector also point to commentary, providing expert guidance about the nature of the conceptual 
dimension's instantiation in that particular case segment; this helps with the problem of teaching 
conceptual knowledge-in-use discussed earUer). Then, as the hypertext program guides the learner in 
criss-crossing the domain's "landscape," by exploring patterns of overlap in the vectors for different case 
segments, knowledge representations are built up in which parts of cases are connected with many 
parts of other cases, along many conceptual/theoretical dimensions of case-segment similarity. In that 
way, many alternative paths are established to get from one part of the overall knowledge base to any 
other part of the knowledge hast that aspects of some ftiture case may signal as relevant. Thus, the 
potential for flexible, situation-adaptive schema assembly is fostered (along vrith such other virtues as 
the establishment of multiple routes for memory access to any node in the system). 

So, for example, in the Cardioworid Explorer segmenU of clinical cases are encoded with a vector of 
clinical and basic biomedical science themes that are relevant to each segment. The system can then 
establish connections between a segment of one case and segments of many other cases, along the 
various (conceptual and clinical) thematic dimensions represented in the vector. In case-based 
instruction, it is often true that there are important, instructive relationships between an aspect of one 
case and aspects of others. Such relationships are rarely brought out. Our hypertext systems capture 
these many lessons that are missed in strict case-by-case (or problem-by-problem) instruction. In an 
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ill-structured domain, facilitating retrieval of multiple (partial) precedents is important, because 
understanding what to do in a given case context will usually require reference to more than any single 
prototype-the case in question will be "kind of like this earlier one, kind of like that one," and so on. 
Also, understanding of the case in question will require that various concepts be brought to bear and 
integrated; this, too, is facilitated by the multiple conceptual coding scheme employed in our systems. 

There are several other benefits of the multiple-conceptual coding of multiple case segments. A 
power/efficiency advantage is that it allows the hypertexts to automatically generate large numbers of 
lessons (many "landscape criss-crossings"). If, for example, each of 20 cases is divided into an average 
of 10 case segments, each with a value on 15 relevant thematic dimensions, there is a many-fold 
increase in the number of possible automatizable instructional comparisons and contrasts that results 
from having 200 case segments (instead of 20 full cases) intertwined by relationships in the 15-slot 
vector. 

Also, the uic of case segments prevents the subsumption to a "common denominator" that occurs when 
larger structural units are used: An interesting local element of a case will tend to get lost if it has 
features that are not prc^^nt in other parts of the case (when the monolithic case is the structural unit). 
Using small case segments (minicases) helps to retain the plurality of situations. 

There is another virtue of the division into case segments and the multidimensional coding of the 
segments that relates to keeping case understanding from being overly simplified. In an ill-structured 
knowledge domain, by defmition, there is sufficient variability across cases (due in part to the 
interaction of the many factors that make up complex cases) that the set of cases that might be 
nominally grouped together under some schema or classification will be greatly variable in their 
particulars. A case, instead of being represented as one kind of thing, conveying one kind of "lesson," is 
instead clearly shown to the learner to be many things. Cases of the same nominal type have different 
segments or scenes that are demonstrated not to be the same, and each of the segments is shown to 
have multiple significances. Therefore, the common temptation to nest cases uniquely under a single 
superordinate conceptual category wiU be resisted, making it less Ukely that the complex relationships 
among cases in a domain will be artificially regularized. In an ill-structured domain, cases are related 
to many different concepts of the domain, and it promotes dysfunctional simplification to hierarchically 
nest or "slot" cases under single conceptual categories (e.g.. The following cases are examples of X 
[only]"). When there is considerable across-case variability, as there will be in an ill-structured domain, 
cognitive flexibility requires that case information be coded conceptually for the many different kinds of 
use that new situations may require. 

The thematic coding scheme and the landscape criss-crossing system of instruction result in a weblike 
multiple interconnectedness on multiple dimensions that is not subject to the limitations of instruction 
that is characterized by a single organizational slant. Instead of a single text with a single 
organizational scheme and a single sequencing of comparisons and contrasts, our hypertexts allow the 
same information to be automatically reconfigured according to a huge number of possible 
organizational schemes, determined by using subsets of the multiple thematic coding space-our 
hypertexts enable the virtually limitless automatic generation of new text configurations. Because of the 
richness of ill-structured domains such as biomedical science, each of these text configurations teaches 
some case- (experience-) grounded lessons that would not have been taught (or easily seen if taught) 
from another text's organizational perspective Such additional experiences and perspectives are 
always helpful in a complex domain-a physician never learns all that it would be helpful to learn 
(which is why additional experience is always valued in a physician). Hypertext systems like the 
Cardioworld Explorer systematically consolidate the process of acquiring cq>erience. 

Yet another virtue of the multiple interconnectedness along multiple dimensions of the representations 
that our systems build has to do with the problem of reciprocal misconception compounding that we 
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have observed in our studies of medical students and physicians (Coukon, et al., 1986; Feltovich, et al., 
tn press). Misconceptions bolster each other and combine to form seductively entrenched networks of 
misconception. Our approach helps to forestall the development of misconception networks by 
developing a kind of positive reciprocation. Because contctfy conceived representations with a high 
degree of multiple intercormectedness are established, the fresh entry of fallacious knowledge at any node 
in the wcblike network will fire off so many connections that it would be akely to activate some 
misconception^abling correct knowledge. Before you can go too far wrong, you are likely to touch 
something that sets you right. 

7. Active Piuticipatloo, Tutorial Guidance, ud AiUunct Support for the Management of Complexity. 
In an ill-structured domain, knowledge cannot just be handed to the learner. A priori codifications of 
knowledge are likely to misrepresent. (That is part of what ill-stnicturedness means.) Hence the 
importance, mcreasingly widely recognized today, of active learner bvolvcment b knowledge 
acquisition, accompanied by opportunistic guidance by expert mentors (which can be bcorporated in a 
computer program-it does not have to be Uve, one-to-one guidance). Furthermore, aids must be 
provided to help the learner manage the added complexity that comes with ill-structure. Our hypertext 
programs allow learners to explore complex conceptual landscapes m many directions, with expert 
guidance and various kinds of cognitive support (e.g., integrated vbuai displays). When there are limits 
to the explicit transmission of knowledge, learners will need special kinds of help m figuring things out 
for themselves (sec Banows & Tamblyn, 1980; Collins, Brown, & Newman, m press; Soiro et al 
1987). f . 

Recapitulation: A Shift fkt>m Single to Multiple Representations and from Generic 
Schema Retrieval to Situation-Specific Knowledge Assembly 

In general, we argue that the goals of advanced knowledge acquisition in complex and ill-structured 
domains can best be attained (and the problems we have identified avoided) by the development of 
mental representations that support cognitive flexibility. Central to the cultivation of cognitive flexibility 
are approaches to learning, instruction, and knowledge representation that: (a) allow an important 
role for multiple representations-, (b) view learning as the multidirectional and multiperspectival "criss- 
crossmg" of cases and concepts that make up complex domains' landscapes" (with resulting 
interconnectedness along multiple dimensions); and (c) foster the ability to assemble diverse 
knowledge sources to adaptivcly T\i the needs of a particular knowledge application situation (rather 
than the search for a precompiled schema that fits die situation). We suggest Uiat theory-based 
computer hypertext systems can implement the goals and strategies of Cognitive Flexibility Theory, 
engendering multiple cognitive representations that capture the real-world complexities of the kinds of 
cases to which abstract conceptual knowledge must be applied. 
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